Extension to the Quantum Langevin Equation in the Incoherent Hopping Regime. 
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An extension to the quantum Langevin equation is derived, that is valid in the incoherent hopping 
regime, and which allows one to incorporate quantum tunneling events. This is achieved by the 
inclusion of additional stochastic variables in the Langevin equation representing the tunneling 
events. A systematic derivation of this extension and of its regime of validity is presented. The 
study is motivated by efforts to determine the error in reading the state of a super-conducting 
quantum bit. 
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The quantum Langevin equation0,0] provides a phys- 
ically appealing and numerically simple description of the 
dynamics of a system coupled to a heat bath. It describes 
the system's non-linear semiclasical dynamics and the ef- 
fects of coupling to quantum and thermal fluctuations in 
the heat bath. It does not, however, describe quantum 
tunneling of the system. Instanton approaches 0, 0, III 
provide a powerful framework in which to describe these 
latter effects. Here, we synthesize these two methods 
within an extended quantum Langevin equation that in- 
cludes quantum tunneling. We focus upon two effects; 
quantum tunneling through or reflection from an energy 
barrier. These may be incorporated into the Langevin 
equation by the inclusion of additional stochastic vari- 
ables, representing the tunneling and reflection events. 
This is valid in the regime of incoherent hopping. 

Specifically, we concentrate upon the case of the 
Josephson junction. Quantum Langevin equations have 
been used extensively in the study of such systems. Re- 
cent experiments)^, Q have probed Josephson junctions 
in regimes where current analytical tools do not provide 
a full description. In the experiments of Refs.gj, a 
Josephson junction was used to read out the state of 
a charge/phase quantum bit. The most recent0 made 
novel use of the non-linear, semi-classical dynamics of 
the junction through its vicinity to a classical bifurcation 
instability. Readout incurred errors due to quantum ef- 
fects (tunneling between phase-space trajectories @) and 
thermal and quantum fluctuations in the transmission 
line. Here, we consider an experimentally realisable al- 
ternative scheme where the junction absorbs energy from 
a chirped microwave pulse with frequency modulated to 
match the response of the junction (whose frequency falls 
as the amplitude of its response increases). Depending 
upon the state of the qubit, the junction will either ab- 
sorb enough energy to surmount the barrier — leading to 
a 7r phase-shift in the reflected signal — or not. The read- 
out incurs errors due to the effect of the bath and due to 
quantum tunneling/reflection at the barrier. 



In order to fully understand such systems one must de- 
scribe the non-linear semi-classical dynamics and quan- 
tum tunneling in concert with coupling to thermal and 
quantum fluctuations in the bath. One approach is to 
follow the evolution of the density matrix through its 
master equation. This is numerically extremely inten- 
sive when the Josephson junction contains more than a 
few levels. An extension of the Langevin equation is, 
therefore, highly desirable 0- We first give a heuristic 
justification for such an extension, before turning to a 
derivation within a Keldysh field theory. We describe 
how this extended Langevin equation may be used to 
estimate errors in the chirped pulse readout scheme. 

Consider a Josephson junction coupled by a transmis- 
sion lead of impedance Z to measurement apparatus. 
The quantum Langevin equation is given byQ 
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(j}(t) is the phase difference of the superconducting order 
parameter across the junction, Cj is the junction capac- 
itance and I j is the Josephson current (Ij = (2e/h)Ej, 
where Ej is the Josephson energy). Fluctuations in the 
transmission line produce a current noise ijv(i)- Id(S) is 
a drive current produced by the microwave source. 

It is useful to explicitly introduce the charge, n(t), on 
the junction and re- write the quantum Langevin equation 
JTJ as a pair of coupled equations; 
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The noise is now given in terms of fluctuations in the 
charge on the transmission lead, q(t). Eliminating n from 
Eqs.|0) and substituting q — In recovers Eq.JTJ. 

The dynamics of the Josephson junction is equivalent 
to that of a rigid pendulum; the superconducting phase 
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difference plays the role of the angle of the pendulum 
and the Josephson potential the role of the gravitational 
potential. If the pendulum does not quite have enough 
energy to perform a complete revolution, classically, it 
will momentarily stop at some angle short of the vertical 
and then reverse its motion. Quantum mechanics allows 
the pendulum to tunnel through the remaining potential 
barrier. If the pendulum does have sufficient energy to 
pass through the vertical, the pendulum may be quan- 
tum mechanically reflected from the barrier and its mo- 
tion reversed. These two processes can be represented 
by boundary conditions for the phase of the junction; 
<j) — > — <j) at t(<j> = 0) and <f> — ► — </> at t{<p — ±7r) or, 
re-expressing these using the first of Eqs. (0 



-<t> at t(n = 0) 
-n at t((f> = ±7r) 



(3) 



At each juncture where the junction/pendulum is mo- 
mentarily stationary short of the vertical or passing 
through the upwards vertical, with some probability, 4> 
and n are modified by quantum processes according to 
Eqs. (|3J). We may heuristically modify the Langevin 
equation in order to incorporate these effects by the ad- 
dition of suitable <5-functions as follows: 
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t a are times such that n(t a ) = and tb such that 
4>{t b ) = ±7f. rj a and rjb are additional stochastic vari- 
ables accounting for the probability of quantum tun- 
neling/reflection. They take the values r\ — or 1 
with a probability P{rf) that is a function of the en- 
ergy of the junction at the stationary point, E = 
Ej(l + cos <£(*)) + n 2 /2C. Without a bath, P(rj 
1 : = l/(e 2lr - E /° + 1), where Q = (2e/h)- s /EjJC is the 
curvature at the top of the junction potential. Cou- 
pling to the bath renormalizes the potential^] giving 

n = {2e/K)^/EjJC \l - (2e/K)^Ej/Z 2 cA . Further 

corrections occur due to the finite drive 0, Q and may 
be incorporated via additional modifications to P(i]). In 
the case of the chirped drive, the potential is zero at the 
stationary points and these corrections are not required. 

In a chirped readout, the junction will gradually absorb 
energy from the microwave drive and go through a num- 
ber of stationary points at which it approaches within 
an (decreasing) energy E of the top of the junction po- 
tential. Coupling to fluctuations in the transmission line 
leads to an energy uncertainty AE — T at high tempera- 
tures; this may be seen by linearizing Eq.(4) around the 



classical, zero-noise solution with a chirped drive. The 
error probability at each stationary point is given by the 
convolution of the distribution of arrival energy with the 
tunneling probability. The total error probability is given 
by X^i" 1 "* [n™=i 1 ( 1 --Pi)]Pni where p n is the error prob- 
ability at the nth stationary point. When the chirped 
drive takes only a few cycles to bring the junction to the 
top of its potential, only the error probability p nma:l will 
be significant. In this case, analytic approximations to 
the error probability may be made. In the more general 
case, numerical integration of Eq.(4) provides an elegant 
way of calculating the cumulative effect of errors. 

Next, we derive the modified Langevin Eq.Q from a 
Keldysh field theory. The kernel for propagation of the 
density matrix may be expressed as a Schwinger-Keldysh 
field theory [H[ll [H [lj. In essence, the Keldysh field 
theory expresses the propagation of the right and left 
projections of the density matrix in terms of fields which 
propagate forwards and backwards in time 14]. It is use- 
ful to make a change of basis to the sums and differ- 
ences of these fields. Since classical field configurations 
take the same value for both forwards and backwards 
propagation in time, the sum is known as the classical 
component (denoted below with a subscript c) and the 
difference is known as the quantum component (denoted 
with a subscript q). In certain circumstances (discussed 
below) the effective theory of the classical components 
can be expressed as a quantum Langevin equation^]. 

The Keldysh Lagrangian for the Josephson junction is 
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+ Ej (COS(0 C + (j) q ) - COS(0 C - (j) q )) 



+Q< (j^i-v) +\ v (t) f dt'r>- l (t,t')V(t')(5) 

The fields n, <fi, Q and V are vectors in the Keldysh 
(quantum/classical) space, e.g 4> = (4> c {t),4> q {t)), except 
where the indices g or c are given explicitly. Q is a 
Lagrange multiplier that imposes the Josephson relation 
V = h(f)/2e and V is the voltage across the junction. The 
first term expresses the fact that <f> and n are conjugate, 
the second term gives the charging energy and the third 
term the Josephson energy (or non-linear inductance en- 
ergy). The final term describes voltage fluctuations at 
the end of the transmission line. The correlation matrix 
is given, in the Keldysh basis, by 



D(ti,t 2 ) = -i(V a (ti)V {t 2 )) 



( D K {t 12 ) D R {t 12 ) 
\ D A (t 12 ) 



where the subscripts K, R and A refer to Keldysh, re- 
tarded and advanced correlators, respectively. These are 
calculated for a transmission lead in thermal equilibrium; 



D R (t 12 ) = D A (t 21 ) = --e(t 1 -t 2 )([V(t 1 ),V(t 2 )}) 



D K (h 2 ) 



-<{n*i),n*2)}> 
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Their Fourier transforms are Dr(lu) = i(u — i8)Z and 
Dk{uj) = 2iuj Z coth(cj / 2T) . The quantum Langevin 
equation can be derived from Eq. © as followsplQ: 
After integrating over Q, V is replaced by H(j)/2e in the 
final term. The Josephson potential term is linearized 

in 6 a , reducing it to 26 a Ej smd) c . This assumes that , _ , , _. T , 

^ q ' 6 , . V , , , FIG. 1: Schematic Diagram of the Real Time Integra- 

tne quantum mechanical spread of trie phase difference ,. „ x , ,. T , s . 

nlTTl mi i • ■ i ■ tion Contour Including Instantons. a) Shows the regime 

is small[15|. The term quadratic m 0, is decoupled of coherent hopping where inst antons are unbound, b) Shows 
via a Hubbard-Stratonovich transformation with a field tne re gi me of incoherent hopping, where instantons are bound 
q. The resulting theory is linear in <p q and n q . Inte- i n pahs, 
grating over these fields leads to J-functionals that im- 
pose Eqs.101. The remaining quadratic Lagrangian for 
q(t) determines its correlation function; (q(w)q(— u)) = 
Dk{u)/{Dr(uj)Da(uj)]. After these manipulations, the 
Keldysh partition function reduces to 



D(j) c Dn c 6 



n 
C 



xS 



" ' 2eJ Z + + 21 J Sin ^ 



x exp 



UjZ 



coth(ftw /2T)q{uj)q(~uj) 
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which is equivalent to Eqs.(0|. 

This derivation ignores instantons; imaginary-time di- 
versions of the Keldysh contour. These describe the 
quantum tunneling and reflection discussed in our heuris- 
tic derivation of the extended Langevin Eq.Q. Instan- 
tons occur on both the outgoing and return parts of the 
Keldysh contour, as shown in Fig.l. Each dot corre- 
sponds to an imaginary time excursion in the evolution of 
the fields in the path integral. During the imaginary-time 
evolution, the potential is inverted and the equations of 
motion are such that the particle can travel between min- 
ima of the potential in a classically forbidden wav|l6|. 

Consider the effect of a single instanton at time to on 
the upper part of the Keldysh contour that takes the for- 
ward propagating <f> + to — <j> + . This instanton leads to 
boundary conditions <p+{tv — + ) = — (f)+(to + + ) in the 
path integral for the real-time evolution of the fields <f>{t) 
and n(t). The probability of this instanton is given by the 
exponential of its classical action 16], possibly modified 
by finite drive currents 0, 0. The full path integral in- 
cludes a sum over all possible configurations and numbers 
of instantons, weighted with the appropriate probability. 
In the absence of a bath, these instantons are positioned 
independently on the Keldysh contour each occurring at 
a stationary point of the classical evolution |l6|. 

Coupling to bath fluctuations induces interactions be- 
tween instantons, tending to bind them in pairs. Pair- 
ing occurs both between instantons and anti-instantons 
on the same part of the Keldysh contour and on oppo- 
site parts of the the Keldysh contour. Consider one in- 
stanton and one anti-instanton both on the upper con- 
tour. In the time between these two instantons, the fields 
on the upper and lower contour are very different and 
<j) q is large. A large cost is incurred in the action due 



to the term (h/2e) 2 <p q (uj) l j) q (-Lu)D K (uj)D Fl 1 (uj)D^ 1 (uj), 
causing an attractive interaction between the instan- 
ton and anti-instanton. Similar arguments apply for an 
instanton/anti-instanton pair on opposite parts of the 
Keldysh contour. The transition between the bound 
and unbound phase of the instantons is the diffu- 
sion/localisation transition of Ref.0]. A large value of 
4> q implies that the system is in a coherent superposition 
of very different classical states. Coupling to a heat bath 
causes this coherence to decay; in a sense the heat bath 
measures the state of the system. 

For an instanton/anti-instanton pair separated by 
a real time r, the quantum component of the junc- 
tion phase is given by (j> q (t) — 2n[9(t + r/2) — 9(t — 
t/2)], so that <f>q{uj) = itt sin(wr/2)/(o;r/2). Using a 
high- momentum cut-off, A and in the limit T — > 0, 
D K /{D A D R ) = 2M(1 + 2e~ h ^/ kT )/Z and the dissi- 
pative contribution to the action is given by Soiss — 
i(h/2e 2 Z)[\n(AT) + (kTr/K) 2 ]. We interpret e lSD "^ h as 
a distribution function for r. At zero temperature, one 
finds that for Z < h/2e 2 the instantons are bound and 
tunneling is incoherent. At finite temperatures, the in- 
stantons are, strictly, always bound on a timescale of 
order t ~ (2ive/k)y/2hZ; coherence between tunneling 
events is lost on timescales greater than this. 

Now let us incorporate these ingredients into an ex- 
tended Langevin equation. The Langevin equation is the 
effective theory of the classical part of the fields, repre- 
sented as a differential equation with noise. Of course, 
it is not always (or even usually) possible to represent 
a field theory in this way. The key feature above that 
allowed the effective theory for the classical components 
to be written in Langevin form was that all terms, aside 
from the coupling to the bath, could be linearized in the 
quantum components. This required that the quantum 
components be small, a condition that is satisfied explic- 
itly in the incoherent hopping regime [ij, |2J, If 5| . In this 
regime, we can decouple the quadratic term in <p q as be- 
fore. The path integral reduces to a sum over sectors with 
different configurations of instanton pairs (we need only 
consider pairs between the upper and lower part of the 
Keldysh contour; those on the same contour will have 
no effect). Each sector is weighted in the sum by the 
probability of producing the instanton pairs[3.IT^|. After 
integrating out n q and <p q the partition function reduces 
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P(t a )P(t b ). (7) 



P(t a ) is the probability of producing the instanton pair 
corresponding to tunneling and P(tb) the probability of a 
pair corresponding to reflection. The path integrals over 
cj> c and n c are carried out with the boundary conditions 
for the configuration of instantons in that sector. We en- 
code these boundary conditions within the <5-functionals 
as follows: 
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Eq. (jSJ is equivalent to the extended Langevin equa- 
tionQ). The drive current Io(t) on the right-hand side 
of the second of Eqs.|@} arises via a term lD(t)4> q (t) in 
Eq.©. The drive leads to a modification of the instanton 
action and probability due to the possibility of photon 
assisted tunnelingQ. The extended quantum Langevin 
equation Q is valid in the regime of incoherent hopping 
provided that the constituent steps — the derivation of 
the quantum Langevin equation itself Q, 0, 0] and the 
instanton calculation 0, 0, — are valid. 

To conclude, we have considered an instanton ex- 
pansion within the Keldysh field theory of a Joseph- 
son junction coupled to a heat bath. Using this ex- 
pansion, we have developed extensions to the quantum 
Langevin equation, which incorporate quantum features 
of the junction dynamics. This extended Langevin equa- 
tion represents a synthesis of established techniques for 
dealing with semi-classical dynamics in the presence of 
environmental fluctuations P, and tunneling 0, It 
is valid in the regime of incoherent hopping. This ex- 
tended Langevin equation allows numerical simulation of 
the junction dynamics in response to a time-dependent 
drive current, including quantum and thermal effects of 
the bath, non-linear classical dynamics and quantum dy- 
namics of the junction. 
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